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ARTICLEINFO ABSTRACT 

Keywords: Background: The Global COVID Vaccine Safety (GCoVS) Project, established in 2021 under the multinational 
Vaccine safety surveillance Global Vaccine Data Network™ (GVDN®), facilitates comprehensive assessment of vaccine safety. This study 
Pharmacovigilance aimed to evaluate the risk of adverse events of special interest (AEST) following COVID-19 vaccination from 10 


Adverse events following immunization 
Adverse events of special interest 
COVID-19 

Observed vs. expected analysis 


sites across eight countries. 

Methods: Using a common protocol, this observational cohort study compared observed with expected rates of 13 
selected AESI across neurological, haematological, and cardiac outcomes. Expected rates were obtained by 
participating sites using pre-COVID-19 vaccination healthcare data stratified by age and sex. Observed rates were 
reported from the same healthcare datasets since COVID-19 vaccination program rollout. AESI occurring up to 
42 days following vaccination with mRNA (BNT162b2 and mRNA-1273) and adenovirus-vector (ChAdOx1) 
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vaccines were included in the primary analysis. Risks were assessed using observed versus expected (OE) ratios 
with 95 96 confidence intervals. Prioritised potential safety signals were those with lower bound of the 95 96 
confidence interval (LBCI) greater than 1.5. 

Results: Participants included 99,068,901 vaccinated individuals. In total, 183,559,462 doses of BNT162b2, 
36,178,442 doses of mRNA-1273, and 23,093,399 doses of ChAdOx1 were administered across participating sites 
in the study period. Risk periods following homologous vaccination schedules contributed 23,168,335 person- 
years of follow-up. OE ratios with LBCI > 1.5 were observed for Guillain-Barré syndrome (2.49, 95 96 CI: 
2.15, 2.87) and cerebral venous sinus thrombosis (3.23, 95 96 CI: 2.51, 4.09) following the first dose of ChAdOx1 
vaccine. Acute disseminated encephalomyelitis showed an OE ratio of 3.78 (95 96 CI: 1.52, 7.78) following the 
first dose of mRNA-1273 vaccine. The OE ratios for myocarditis and pericarditis following BNT162b2, mRNA- 
1273, and ChAdOx1 were significantly increased with LBCIs > 1.5. 

Conclusion: This multi-country analysis confirmed pre-established safety signals for myocarditis, pericarditis, 
Guillain-Barré syndrome, and cerebral venous sinus thrombosis. Other potential safety signals that require 


further investigation were identified. 


1. Introduction 


Since declaration of the COVID-19 pandemic by the World Health 
Organization (WHO) on March 11, 2020 [1] more than 13.5 billion doses 
of COVID-19 vaccines have been administered worldwide [2]. As of 
November 2023, at least 70.5 96 of the world's population had received at 
least one dose of a COVID-19 vaccine [2]. This unparalleled scenario un- 
derscores the pressing need for comprehensive vaccine safety monitoring 
as very rare adverse events associated with COVID-19 vaccines may only 
come to light after administration to millions of individuals. 

In anticipation of this unprecedented global rollout of COVID-19 
vaccines, the Safety Platform for Emergency vACcines (SPEAC) initia- 
tive formulated a list of potential COVID-19 vaccine adverse events of 
special interest (AEST) in 2020 [3]. AESI selection was based on their 
pre-established associations with immunization, specific vaccine plat- 
forms or adjuvants, or viral replication during wild-type disease; theo- 
retical concerns related to immunopathogenesis; or supporting evidence 
from animal models using candidate vaccine platforms [3]. 

One flexible approach for assessing AESI is the comparison of 
observed AESI rates following the introduction of a vaccine program 
with the expected (or background) rates based on historical periods pre- 
vaccine roll out [4,5]. Such comparisons can be executed rapidly and 
can play a key role in early detection of potential vaccine safety signals 
or when regulatory and public health agencies need rapid assessment of 
an emerging safety signal [4,6]. Observed versus (vs.) expected (OE) 
analysis was integral in identifying thrombosis with thrombocytopenia 
syndrome (TTS) as a safety signal, prompting the suspension of use of 
the ChAdOx1 (AstraZeneca COVID-19 vaccine) on March 11, 2021, in 
Denmark and Norway [7,8]. 

These evaluations are not only valuable early-on in large-scale vac- 
cine deployment, but also as the vaccination program matures, espe- 
cially if they can be conducted in a multi-country context. We conducted 
a global cohort study following the Observed vs. Expected Analyses of 
COVID-19 Adverse Events of Special Interest Study Protocol [9] with 
data from 10 sites across eight countries participating in the unique 
Global COVID Vaccine Safety (GCoVS) Project [10] of the Global Vac- 
cine Data Network™ (GVDN®) [11]. The GCoVS Project, initiated in 
2021, is a Centers for Disease Control and Prevention (CDC) funded 
global collaboration of investigators and data sources from multiple 
nations for the purpose of COVID-19 vaccine safety monitoring. 


2. Methods 
2.1. Study design 
This retrospective observational study was designed to estimate the 


OE ratios of selected AESIs after COVID-19 vaccination in a multi- 
country population cohort. 
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2.2. Data source and study population 


The GCoVS Project compiled electronic healthcare data on AESI 
related to COVID-19 vaccines from participants across multiple sites 
within the GVDN network, including Argentina, Australia - New South 
Wales, Australia — Victoria, Canada - British Columbia, Canada - 
Ontario, Denmark, Finland, France, New Zealand, and Scotland [10]. 
The healthcare data comprised of either individual- or population-level 
data, depending on the availability in the study sites (Supplementary 
Table 1). 

Immunization registers containing individual-level vaccination data 
were utilized by the majority of study sites. These registers covered the 
same population and geographic region as the data sets used to calculate 
background rates. We also examined population-level data on vaccina- 
tion uptake using regularly updated dashboards from the study sites. If 
the number of individuals vaccinated in specific age and gender groups 
was available, we converted those numbers into person-years based on 
the post-vaccination risk period. Unlike the registers with individual- 
level data, the age and sex strata used in this approach might not have 
matched the strata used in the background rates calculations. 

Participants were individuals vaccinated with COVID-19 vaccines in 
the populations represented by the sites. To the extent possible, stan- 
dardized methods were applied across sites. Patient types included 
hospital inpatients (Australia - New South Wales, France, New Zealand, 
Scotland), and combinations of inpatient and outpatient emergency 
department patients (Argentina, Australia — Victoria, Canada, Denmark, 
Finland). In countries without clearly defined patient types, hospital 
contact duration was used as a proxy for patient types. As an example, a 
contact duration of five hours or longer was used as a proxy for in- 
patients in Denmark. Site-specific characteristics of data sources and 
data are presented in Supplementary Table 1. 


2.3. Study period and follow-up 


The study periods varied across countries, commencing on the date 
of the site-specific COVID-19 vaccination program rollout, and 
concluding at the end of data availability (Table 1). In general, the study 
periods spanned from December 2020 until August 2023. The shortest 
study period observed occurred in Australia - New South Wales, 
including 11 months from February 2021 to December 2021. Argentina 
had the longest study period, from December 2020 to August 2023, 
encompassing a total of 32 months. 

The risk intervals used after each dose were 0—7 days, 8-21 days, 
22-42 days, and 0-42 days. For each vaccination dose, day 0 was 
denoted the day of vaccine receipt. For this manuscript, we present re- 
sults for the risk interval of 0-42 days only. More data are presented on 
the GVDN dashboard with all latest updates from participating sites 
[12]. Outcome events that occurred outside the study period were not 
included. A 365-day washout period for outcome events was used to 
define incident outcomes. Outcome events were considered incident if 
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there was no record of the same outcome event during the preceding 
365-day washout period. An individual may have contributed several 
outcome events on the condition they were separated in time by at least 
the washout period of 365 days. 


2.4. Study variables and outcomes 


2.4.1. Adverse events of special interest (AESI) 

Thirteen conditions representing AESI of specific relevance to the 
current landscape of real-world vaccine pharmacovigilance were 
selected from the list compiled by the Brighton Collaboration SPEAC 
Project [3] and in response to the safety signals of thrombosis with 
thrombocytopenia syndrome [7,8] (Supplementary Table 2). The con- 
ditions chosen matched the AESI for which background rates were 
recently generated by GVDN sites [13]. AESI were identified using 
harmonized International Classification of Diseases 10th Revision (ICD- 
10) codes. Neurological conditions selected included Guillain-Barré 
syndrome (GBS), transverse myelitis (TM), facial (Bell’s) palsy, acute 
disseminated encephalomyelitis (ADEM), and convulsions (generalized 
seizures (GS) and febrile seizures (FS)) as potential safety signals have 
been identified for some of these conditions [14-16]. Hematologic 
conditions included cerebral venous sinus thrombosis (CVST), 
splanchnic vein thrombosis (SVT) and pulmonary embolism (PE); the 
unusual site thromboses (CVST and SVT) were selected as markers of 
potential TTS that could be accurately identified using diagnostic codes 
[17,18]. Thrombocytopenia and immune thrombocytopenia (ITP) were 
also included due to their association with TTS and reports of ITP as an 
independent safety signal [7,19,20]. Myocarditis and pericarditis were 
included as cardiovascular conditions and the OE ratios were evaluated 
separately for each condition [21-23]. 


2.4.2. COVID-19 vaccines 

As of November 2023, multiple vaccines against COVID-19 were in 
use by the GCoVS sites representing multiple platform types such as 
inactivated, nucleic acid-based (mRNA), protein-based, and non- 
replicating viral vector platforms (Table 2). For this manuscript, we 
focused on three vaccines that recorded the highest number of doses 
administered, Pfizer/BioNTech BNT162b2, Moderna mRNA-1273, and 
Oxford/Astra Zeneca/Serum Institute of India ChAdOx1 vaccines. The 
cumulative number of doses of other vaccines administered (n) across 
study sites were relatively low, with exceptions for the inactivated 
Sinopharm (n — 134,550) and Sinovac (n — 31,598) vaccines, the 
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Table 2 
Total number of vaccinations by brand. 


Vaccine platform Vaccine brand Total doses 


Inactivated Covilo or SARS-CoV-2 Vaccine (Vero Cell) 134,550 
[Sinopharm (Beijing)] 
Covaxin [Bharat Biotech] 1,660 
CoronaVac or Sinovac [Sinovac Biotech] 31,598 
Inactivated (Vero cell) [Sinopharm (Wuhan)] 623 
Nucleic acid- Comirnaty or Riltozinameran or Pfizer/ 3,516,963 
based BioNTech COVID-19 Vaccine Bivalent [Pfizer/ 
BioNTech] 
Comirnaty or Tozinameran [Pfizer/BioNTech 183,677,660 
or Fosun-BioNTech] 
Comirnaty or Tozinameran Paediatric [Pfizer/ 2,439,086 
BioNTech or Fosun-BioNTech] 
Spikevax bivalent Original/Omicron 2,750,476 
[Moderna] 
Elasomeran or Spikevax or TAK-919 Half Dose — 400,395 
[Moderna or Takeda] 
Elasomeran or Spikevax or TAK-919 36,222,514 


[Moderna or Takeda] 


Protein-based MVC-COV1901 [Medigen] 16 


Covovax or Nuvaxoid [Novavax or Serum 66,856 
Institute of India] 
Non-replicating Convidecia or Convidence [CanSino] 3,938 
viral vector Covishield or Vaxzevria [AstraZeneca or 23,094,620 


Serum Institute of India] 
Sputnik Light or Gam-COVID-Vac [Gamaleya 26 
Research Institute] 

Sputnik V [Gamaleya Research Institute] 
Janssen [Janssen/Johnson & Johnson] 


84,460 
1,137,505 


protein-based Novavax (n — 66,856) vaccine, and the adenovirus-vector 
Janssen/Johnson & Johnson (n — 1,137,505) and Gamaleya Research 
Institute/Sputnik (n — 84,460) vaccines. The total number of doses of 
each vaccine brand administered are outlined in Table 2. Exposure to 
COVID-19 vaccine by platform/type, brand, and dose data were avail- 
able at the individual level to determine the number of observed cases by 
vaccine type/brand and dose profile and within the 0-42 days post- 
vaccination risk interval. 


2.5. Statistical analysis 


2.5.1. Calculation of observed vs. expected ratios for each site 
For each site, we calculated the observed number of events for each 
AESI in the risk interval after introduction of COVID-19 vaccination. To 


Population summary by site. (Only Pfizer/BioNTech BNT162b2, Moderna mRNA-1273, and Oxford/Astra Zeneca/Serum Institute of India ChAdOx1 vaccines and 


doses 1-4 included). 


Characteristics Argentina Australia: NSW Australia: Victoria Canada: BC Canada: Ontario Denmark Finland France New Zealand Scotland 

Study period 12/2020-08/2023  02/2021-12/2021  02/2021-06/2023 12/2020-05/2023 12/2020-03/2023 12/2020-02/2023  12/2020-06/2022  01/2021-12/2021  02/2021-09/2022  12/2020-05/2023 

Vaccinated population n 157,883 6,492,805 5,789,070 4,267,644 12,081,337 4,291,034 4,501,659 52,795,394 4,151,269 4,540,806 
Female (96) 78,374 (49.6) 3,289,381 (50.7) ^ 2,925,886 (50.5) 2,183,666 (51.2) ^ 6,192,991 (51.3) 2,179,415 (50.8) 2,324,067 (51.6) 27,216,365 (51.6) 2,100,071 (50.6) ^ 2,346,694 (51.7) 
0-19 (36) 42,281 (26.8) 692,498 (10.7) 921,635 (15.9) 274,813 (6.4) 1,882,574 (15.6) 620,273 (14.5) 549,589 (12.2) 5,585,455 (10.6) 582,662 (14.0) 501,397 (11.0) 
20-39 (96) 58,567 (37.1) 2,125,624 (32.7) ^ 1,858,706 (32.1) 1,386,513 (32.5) ^ 3,421,403 (28.3) 1,100,566 (25.6) 1,159,303 (25.8) 14,517,426 (27.5) 1,321,332 (31.8) 1,218,142 (26.8) 
40-59 (36) 40,484 (25.6) 1,933,770 (29.8) ^ 1,586,558 (27.4) 1,244,817 (29.2) ^ 3,460,295 (28.6) 1,263,265 (29.4) 1,256,439 (27.9) 16,065,061 (30.4) 1,198,750 (28.9) ^ 1,418,313 (31.2) 
60-79 (%) 15,167 (9.6) 1,433,446 (22.1) 1,139,623 (19.7) 1,103,315 (25.9) 2,706,343 (22.4) 1,063,018 (24.8) 1,234,825 (27.4) 12,997,416 (24.6) 865,928 (20.9) 1,142,053 (25.2) 
80+ (%) 1,384 (0.9) 307,467 (4.7) 282,548 (4.9) 258,186 (6.0) 610,722 (5.1) 243,912 (5.7) 301,503 (6.7) 3,630,036 (6.9) 182,597 (4.4) 260,901 (5.7) 

BNT162b2 Dose 1 3,896,923 (60.0) 3,393,207 (58.6) 2,959,369 (69.3) ^ 8,473,103 (70.1) 3,425,161 (79.8) 3,586,237 (79.7) 41,450,092 (78.5) 4,036,859 (97.2) ^ 2,087,109 (46.0) 
Dose 2 3,837,153 (59.1) 3,313,758 (57.2) 2,778,036 (65.1) 7,382,893 (61.1) 3,480,685 (81.1) 3,594,661 (79.9) 38,876,671 (73.6) 3,990,353 (96.1) 1,967,726 (43.3) 
Dose 3 751,169 (11.6) 2,900,036 (50.1) 1,295,609 (30.4) 4,377,649 (36.2) 2,811,507 (65.5) 2,167,380 (48.1) 16,121,693 (30.5) 2,730,880 (65.8) 2,557,434 (56.3) 
Dose 4 969,442 (16.7) 259,228 (6.1) 1,469,297 (12.2) 1,609,558 (37.5) 54,905 (0.1) 595,269 (14.3) 358,410 (7.9) 

mRNA-1273 Dose 1 2,850 (1.8) 134,960 (2.1) 199,865 (3.5) 940,656 (22.0) 2,100,866 (17.4) 507,031 (11.8) 554,076 (12.3) 5,853,595 (11.1) 3,255 (0.1) 205,528 (4.5) 
Dose 2 13,046 (8.3) 126,291 (1.9) 190,271 (3.3) 1,196,017 (28.0) 3,589,447 (29.7) 578,985 (13.5) 532,153 (11.8) 5,880,520 (11.1) 3,211 (0.1) 183,966 (4.1) 
Dose 3 45,712 (29.0) 117,804 (1.8) 617,724 (10.7) 1,482,817 (34.7) 2,965,640 (24.5) 61,548 (1.4) 812,002 (18.0) 4,676,771 (8.9) 2,184 (0.1) 970,917 (21.4) 
Dose 4 257,557 (4.4) 380,862 (8.9) 723,201 (6.0) 56,850 (1.3) 14,245 (<0.1) 134 (<0.1) 195,885 (4.3) 

ChAdOx1 Dose 1 37,721 (23.9) 2,460,922 (37.9) 1,868,764 (32.3) 308,867 (7.2) 856,603 (7.1) 133,181 (3.1) 360,196 (8.0) 4,398,411 (8.3) 17,087 (0.4) 2,139,669 (47.1) 
Dose 2 36,164 (22.9) 2,433,046 (37.5) ^ 1,835,469 (31.7) 132,111 (3.1) 221,118 (1.8) 1,780 («0.1) 191,120 (4.2) 3,424,058 (6.5) 14,560 (0.4) 2,093,121 (46.1) 
Dose 3 28,255 (17.9) 7,483 (0.1) 57,841 (1) 1,757 («0.1) 46 («0.1) 306 («0.1) 7,368 («0.1) 2,058 («0.1) 9,551 (0.2) 
Dose4 13,693 (0.2) 76 («0.1) 90 («0.1) 212 («0.1) 695 («0.1) 


Vaccines: Pfizer/BioNTech (BNT162b2), Moderna (mRNA-1273), and Oxford/Astra Zeneca/Serum Institute of India (ChAdOx1). 
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calculate the expected number of cases, we used pre-COVID-19 vacci- 
nation background rates data from 2015 to 2019 (2019-2020 for 
Denmark) collected in the GCoVS Background Rates of AESI Following 
COVID-19 vaccination study [13]. The observed follow-up period in 
person-years for a given vaccination profile and post-vaccination period 
was stratified according to age group and sex. Each of the age-sex 
stratified person-years were multiplied by the corresponding age-sex 
stratified background rate. This resulted in the expected number of 
cases in each stratum, which were then summed to give the total number 
of expected cases during the observed follow-up period. 

The aggregated OE ratios by last dose were calculated by dividing the 
observed number of cases by the expected number of cases in the post- 
vaccination period, 95 96 confidence intervals (CI) were derived using 
the exact Poisson distribution. We also calculated OE ratios for homol- 
ogous schedules for BNT162b2, mRNA-1273, and ChAdOx1 vaccines up 
to four doses. Both the aggregated OE ratios and those specific to ho- 
mologous schedules are presented. 

We considered an OE ratio a potential safety signal of concern where 
the lower bound of the 95 96 CI (LBCI) was greater than one and reached 
statistical significance [5]. However, we prioritised potential safety 
signals of concern for further evaluation where the LBCI was greater 
than 1.5, due to increased statistical evidence and the higher likelihood 
of being a true signal, based on expert opinion from the CDC and GVDN 
collaborators. 


2.5.2. Combining results across sites 

The results were aggregated across sites by summing the observed 
number of events for each AESI and the age-sex stratified person-years 
for a given vaccination profile and post-vaccination period. For each 
AESI, individual vaccine profiles were reported if the cumulative 
amount of follow up (in person-years) in the 0-42 days post-vaccination 
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period was 10,000 or greater. The combined numbers of events and the 
OE ratio was calculated with 95 96 CIs derived using the exact Poisson 
distribution. No event (i.e., zero) observed for a vaccine brand and dose 
profile was reported separately without CI. 


2.5.3. Sensitivity analysis 

Firstly, we conducted site-specific sensitivity analyses to further 
explore potential associations of the most significant safety signals 
identified in the main analysis. The observed rates reported by sites were 
considered in the analysis based on the following constraints. For each 
vaccine brand and dose profile, and post-vaccination period combina- 
tion, the OE ratios and 95 96 CI were suppressed if fewer than five events 
were observed. Secondly, we conducted supplemental analysis including 
other vaccines and doses administered across sites. The person-years 
threshold for reporting was lowered from 10,000 to 1,000 person- 
years compared to the main aggregated OE ratios analysis, allowing 
for broader scope of vaccines to be analysed. 


2.6. Ethical approval 


Approval from the relevant Human Research Ethics Committees was 
either acquired or an exemption obtained for all participating sites 
(Supplementary Table 3). 


3. Results 


The total vaccinated population across all sites comprised 
99,068,901 individuals. Most vaccine recipients were in the 20—39 and 
40-59-year age groups (Table 1). In total, 183,559,462 doses of 
BNT162b2, 36,178,442 doses of mRNA-1273, and 23,093,399 doses of 
ChAdOx1 were administered across all the sites in the study periods. The 


Table 3 
Aggregated OE Ratios by last dose, neurological conditions, period 0-42 days. 
GBS TRM BP ADEM FSZ GSZ 
Dose Vaccine OERatio — 95%Cl OE Ratio  95%CI OE Ratio  95%CI OE Ratio  95%CI OE Ratio 95%CI OE Ratio  95%CI 


ChAdOx1 
BNT162b2 
mRNA-1273 


ChAdOx1 
BNT162b2 
mRNA-1273 


ChAdOx1 
BNT162b2 
mRNA-1273 


BNT162b2 
mRNA-1273 


AESI: GBS= Guillain-Barré syndrome, TRM= Transverse myelitis, BP= Facial (Bell's) palsy, ADEM= Acute disseminated encephalomyelitis, FSZ- Febrile seizures, 


GSZ- Generalised seizures 


Vaccines: Pfizer/BioNTech (BNT162b2), Moderna (mRNA-1273), and Oxford/Astra Zeneca/Serum Institute of India (ChAdOx1) 


Thresholds for statistical indications of potential signals: 
[Red: | LBCI* >1.5, statistically significant safety signal 
[Yellow:] LBCI* >1 and «1.5, statistically significant 
[Green:] LBCI* «1.0, not statistically significant 

*LBCI: Lower bound of confidence interval 

Conditions applied to the analysis of aggregated OE ratios: 


PYRS 210000 


No censoring on observed counts 


AESI: GBS — Guillain-Barré syndrome, TRM — Transverse myelitis, BP — Facial (Bell's) palsy, ADEM — Acute disseminated encephalomyelitis, FSZ — Febrile seizures, 


GSZ — Generalised seizures. 


Vaccines: Pfizer/BioNTech (BNT162b2), Moderna (mRNA-1273), and Oxford/Astra Zeneca/Serum Institute of India (ChAdOx1). 
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Table 4 
Aggregated OE Ratios by last dose, haematologic conditions, period 0-42 days. 
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THR ITP PEM 


CVST SVT 


Dose Vaccine OE Ratio 95%CI OE Ratio 95%CI OE Ratio 


ChAdOx1 
BNT162b2 
mRNA-1273 


ChAdOx1 
BNT162b2 
mRNA-1273 


ChAdOx1 
BNT162b2 
mRNA-1273 


BNT162b2 
mRNA-1273 


95%CI 


OE Ratio 95%CI OE Ratio 95%CI 


AESI: THR= Thrombocytopenia, ITP= Idiopathic thrombocytopenia, PEM= Pulmonary embolism, CVST=Cerebral venous sinus thrombosis, SVT= Splanchnic vein thrombosis 


Vaccines: Pfizer/BioNTech (BNT162b2), Moderna (mRNA-1273), and Oxford/Astra Zeneca/Serum Institute of India (ChAdOx1) 


Thresholds for statistical indications of potential signals: 
[Red: | LBCI* >1.5, statistically significant safety signal 
[Yellow:] LBCI* >1 and <1.5, statistically significant 
[Green:| LBCI* <1.0, not statistically significant 

*LBCI: Lower bound of confidence interval 

Conditions applied to the analysis of aggregated OE ratios: 


PYRS 210000 


No censoring on observed counts 


AESI: THR = Thrombocytopenia, ITP = Idiopathic thrombocytopenia, PEM = Pulmonary embolism, CVST = Cerebral venous sinus thrombosis, SVT = Splanchnic vein 


thrombosis. 


Vaccines: Pfizer/BioNTech (BNT162b2), Moderna (mRNA-1273), and Oxford/Astra Zeneca/Serum Institute of India (ChAdOx1). 


highest numbers of doses were administered in France (120,758,419), 
followed by Canada - Ontario (32,159,817) and Australia — Victoria 
(15,617,627). In total, 23,168,335 person-years contributed to the OE 
ratios for the AESI following homologous schedules. The population 
summary is presented in Table 1, and more detailed information on the 
other administered vaccines are presented in Supplementary Table 4. In 
the results sections below, we provide both aggregated OE ratios 
(Tables 3-5) and detailed OE ratios for homologous schedules 
(Figs. 1-3), including the number of events and person-years. Overall, 
95.8 96 and 86.6 % of vaccinations were included in the aggregated and 
the homologous schedules analysis, respectively (Supplementary Table 
5). The primary results from the individual sites as well as additional risk 
periods and meta-analyses for each AESI are available in the interactive 
GVDN Observed vs Expected (OE) Dashboard [12]. 


3.1. Neurological conditions 


There was a statistically significant increase in GBS cases within 42 
days after a first ChAdOx1 dose (OE ratio = 2.49; 95 96 CI: 2.15, 2.87), 
indicating a prioritised safety signal (Table 3). Seventy-six GBS events 
were expected, and 190 events were observed (Fig. 1). The OE ratio for 
ADEM within 42 days after a first mRNA-1273 dose also fulfilled the 
significance threshold of a prioritised safety signal (3.78; 95 96 CI: 1.52, 
7.78), with two expected events compared with seven observed events 
(Fig. 1). 

Statistically significant differences were also found for transverse 
myelitis (OE ratio — 1.91; 95 96 CI: 1.22, 2.84) and ADEM (OE ratio — 
2.23; 95 96 CI: 1.15, 3.90) after a first ChAdOx1 dose. Bell’s palsy had an 
increased OE ratio after a first dose of BNT162b2 (1.05; 95 96 CI: 1.00, 
1.11) and mRNA-1273 (1.25; 95 % CI: 1.11, 1.39). There were also 
increased OE ratios for febrile seizures following a first and second dose 
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of mRNA-1273 (1.36, 95 96 CI: 1.02, 1.77 and 1.44, 95 96 CI: 1.04, 1.95, 
respectively), and for generalised seizures following a first mRNA-1273 
dose (1.15, 95 96 CI: 1.10, 1.20) and a fourth BNT162b2 dose (1.09, 95 96 
CI: 1.04, 1.14). No increased OE ratios were identified following a third 
dose of any vaccine. The results are concordant with the OE ratios of 
homologous schedules; however, an increased OE ratio for generalized 
seizures following a homologous schedule of four doses of mRNA-1273 
(1.33; 95 96 CI: 1.07, 1.63) was identified (Fig. 1). These outcomes did 
not meet the threshold for a prioritised safety signal following 
vaccination. 


3.2. Hematologic conditions 


The OE ratio of CVST was 3.23 (95 96 CI: 2.51-4.09) within 42 days 
after a first dose of ChAdOx1, fulfilling the threshold of a prioritised 
safety signal (Table 4). In total, 21 events were expected, while 69 
events were observed (Fig. 2). 

Increased OE ratios were also identified for thrombocytopenia after a 
first dose of ChAdOx1 (1.07; 95 96 CI: 1.03, 1.12), BNT162b2 (1.11; 95 
96 CI: 1.08, 1.14), and mRNA-1273 (1.33; 95 96 CI 1.25, 1.42), as well as 
after a third dose of ChAdOx1 (1.95; 95 96 CI: 1.29, 2.84). Immune 
thrombocytopenia also demonstrated increased OE ratios after a first 
dose of ChAdOx1 (1.40; 95 % CI: 1.24, 1.58) and BNT162b2 (1.08; 95 96 
CI: 1.01, 1.16). Pulmonary embolism OE ratios were increased following 
first doses of ChAdOx1 (1.20; 95 96 CI: 1.16, 1.24), BNT162b2 (1.29; 95 
96 CI: 1.26, 1.32), and mRNA-1273 (1.33, 95 96 CI: 1.26, 1.40), as well as 
after a third dose of ChAdOx1 (1.88; 95 96 CI: 1.32, 2.58). The OE ratio 
of CVST was 1.49 (95 96 CI: 1.26, 1.75) after a first dose and 1.25 (95 96 
CI: 1.06, 1.46) after a second dose of BNT162b2. An increased OE ratio 
for SVT was found after a first dose of BNT162b2 (1.25; 95 96 CI: 1.17, 
1.34) and mRNA-1273 (1.23; 95 96 CI: 1.03, 1.47); a second dose of 
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Table 5 
Aggregated OE Ratios by last dose, cardiovascular conditions, period 0-42 days. 


Vaccine 42 (2024) 2200-2211 


MYO PER 


OE Ratio 


Dose Vaccine 95%Cl OE Ratio 95%Cl 


1 ChAdOx1 
BNT162b2 
mRNA-1273 


2 ChAdOx1 
BNT162b2 
mRNA-1273 


3 ChAdOx1 
BNT162b2 
mRNA-1273 


4 BNT162b2 
mRNA-1273 


AESI: MYO= Myocarditis, PER= Pericarditis 


Vaccines: Pfizer/BioNTech (BNT162b2), Moderna (mRNA-1273), and Oxford/Astra Zeneca/Serum Institute of India (ChAdOx1) 


Thresholds for statistical indications of potential signals: 

[Red: | LBCI* >1.5, statistically significant safety signal 

Yellow: | LBCI* >1 and <1.5, statistically significant 

[Green:] LBCI* «1.0, not statistically significant 

*LBCI: Lower bound of confidence interval 

Conditions applied to the analysis of aggregated OE ratios: 
-  PYRS 210000 


-  Nocensoring on observed counts 


mRNA-1273 (1.17; 95 96 CI: 1.01, 1.36); and a fourth dose of BNT162b2 
(1.30, 95 96 CI: 1.06, 1.59) and mRNA-1273 (1.53, 95 96 CI: 1.05, 2.16). 
These outcomes did not meet the threshold for a prioritised safety signal 
following vaccination. 


3.3. Cardiovascular conditions 


Increased OE ratios fulfilling the threshold of prioritised safety sig- 
nals for myocarditis were consistently identified following a first, second 
and third dose of mRNA vaccines (BNT162b2 and mRNA-1273) 
(Table 4). The highest OE ratio was observed following a first and sec- 
ond dose of mRNA-1273 (3.48; 95 96 CI: 3.00, 4.01 and 6.10; 95 96 CI: 
5.52, 6.72, respectively). The OE ratio following a third dose of mRNA- 
1273 was 2.01 (95 96 CI: 1.60, 2.49). The numbers of events for up to 
four doses of homologous schedules are shown in Fig. 3. The OE ratios of 
homologous schedules align with the aggregated OE ratios. The ho- 
mologous OE for myocarditis following four doses of mRNA-1273 vac- 
cine could not be estimated due to a lack of observed events. 

Similarly, the OE ratio for pericarditis fulfilled the threshold of a 
prioritised safety signal following a first and fourth dose of mRNA-1273, 
with OE ratios of 1.74 (95 % CI: 1.54, 1.97) and 2.64 (95 96 CI: 2.05, 
3.35) respectively. An increased ratio of 6.91 (95 96 CI: 3.45, 12.36), 
fulfilling the threshold of a prioritised safety signal, was also observed 
following a third dose of ChAdOx1. The aggregated OE ratios for peri- 
carditis were increased following all doses of all the three vaccines 
presented (Table 4). The results are very similar to the ratios of 
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homologous schedules (Fig. 3), except for the OE ratio of 1.23 (95 96 CI: 
0.45-2.69) after receipt of the fourth mRNA-1273 dose, which did not 
meet the threshold for a safety signal. The homologous OE ratio 
following a third dose of ChAdOx1 was not reported as only a small 
number of third doses of ChAdOx1 were given across study sites 
(Table1). 


3.4. Sensitivity analysis 


Secondary analyses were conducted to further explore GBS, ADEM, 
CVST, myocarditis, and pericarditis at the site-specific level. We report 
the aggregated OE ratios by last dose and site in the period 0-42 days 
after vaccination in Supplementary Tables 6-10. It was not possible to 
report results for all sites and study outcomes due to insufficient person- 
years or less than five events observed by site privacy criteria. The 
majority of identified safety signals following specific vaccine brand and 
dose combinations from the main analysis were, however, confirmed by 
individual sites where data were available. The supplementary analysis 
with person-years threshold of 1,000 and including other vaccines and 
doses administered within the GVDN sites, showed an increased OE ratio 
for some outcomes, e.g. for generalized seizures following a first dose of 
Gamaleya Research Institute/Sputnik vaccine (5.50, 95 96 CI: 2.74, 9.84) 
(Supplementary Tables 11-13). 
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Fig. 1. Number of events and OE ratios (with 95 % confidence interval) for homologous schedules by dose 1-4, neurological conditions. AESI: GBS = Guillain-Barré 
syndrome, TRM = Transverse myelitis, BP = Facial (Bell’s) palsy, ADEM = Acute disseminated encephalomyelitis, FSZ = Febrile seizures, GSZ = Generalised sei- 
zures. Vaccines: AZD = Oxford/Astra Zeneca/Serum Institute of India ChAdOx1, BNT = Pfizer/BioNTech (BNT162b2), MOD = Moderna (mRNA-1273). 


4. Discussion 


This multi-country cohort study was conducted in the unique setting 
of the GVDN. To date, the number of such large systematically coordi- 
nated studies across diverse geographical locations and populations is 
limited. However, several studies have previously assessed the risks of 
the identified safety signals following COVID-19 vaccination, primarily 
in single site settings. We investigated the association between COVID- 
19 vaccination and 13 AESIs comprising neurological, haematological, 
and cardiovascular conditions across 10 sites in eight countries 
including Europe, North America, South America, and Oceania. In this 
study including more than 99 million people vaccinated against SARS- 
CoV-2, the risk up to 42 days after vaccination was generally similar 
to the background risk for the majority of outcomes; however, a few 
potential safety signals were identified. We observed potential safety 
signals for GBS and CVST after the first dose of ChAdOx1 based on more 
than 12 million doses administered. 

Overall, studies of the vector-based vaccines such as the ChAdOx1, 
have observed a higher incidence of GBS after vaccination compared 
with the background incidence; whereas, most studies of the mRNA 
vaccines, such as BNT162b2 and mRNA-1273, have not observed in- 
creases of GBS [14,15,24-27]. Atzenhoffer et al. [24] reported an 
elevated OE ratio > 2.0 for adenovirus-vectored COVID-19 vaccines, 
across countries contributing to VigiBase, an international database of 
adverse drug events and Patone et al. [27] reported 38 excess cases of 
GBS per 10 million exposed in the 1-28 days risk period following 
vaccination with ChAdOx1 in England. The authors did not observe an 
increased risk in those who received BNT162b2. In contrast, a study by 
Li et al. [28] showed no increased risk of GBS for ChAdOx1, while only 
SARS-CoV-2 infection was associated with a higher risk. The discrep- 
ancy, compared with the results of Patone et al. [27], could however be 
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explained by a smaller sample size and different outcome measures. 
Overall, this evidence supports our findings of a GBS safety signal 
following ChAdOx1 vaccination. Although rare, this association was 
acknowledged by the WHO, the European Medicines Agency (EMA), and 
Therapeutic Goods Administration (TGA) of Australia, resulting in GBS 
being listed as a rare side effect following exposure to ChAdOx1 
[15,29,30]. 

The identified increased risk of CVST following ChAdOx1 vaccina- 
tion in this study is corroborated by multiple studies. An increased OE 
ratio was observed in a nationwide cohort study from Denmark and 
Norway, with increased rates of venous thromboembolic events, 
including CVST with an excess rate of 2.5 events per 100,000 vaccina- 
tions following ChAdOx1 [7]. Based on a variety of methodologies, other 
studies have also reported increased incidence of CVST after vaccination 
[31,32]. Ultimately, this rare but concerning safety signal led to the 
withdrawal of the ChAdOx1 vaccine from COVID-19 vaccine programs 
or implementation of age-based restrictions in multiple countries [8]. 

It is crucial to acknowledge the significance threshold of prioritised 
safety signals applied in this study (LBCI > 1.5). This threshold was 
selected based on expert opinion within the GVDN and at CDC, to focus 
on those outcomes most likely to be true signals. Some observed events, 
although not fulfilling this threshold, may still hold clinical importance 
and require further investigation. For instance, ITP with an OE ratio > 
1.0 and LBCI of 1.2 following vaccination with ChAdOx1 aligns with 
findings reported in the literature as a potential signal. This concurrence 
is highlighted in a study conducted in Victoria, Australia, which 
observed a substantially higher than expected rate of ITP following 
ChAdOx1 vaccination [33]. 

Moreover, we observed significantly higher risks of myocarditis 
following the first, second and third doses of BNT162b2 and mRNA- 
1273 as well as pericarditis after the first and fourth dose of mRNA- 
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Fig. 2. Number of events and OE ratios (with 95 96 confidence interval) for homologous schedules by dose 1-4, hematologic conditions. AESI: THR — Thrombo- 
cytopenia, ITP — Idiopathic thrombocytopenia, PEM — Pulmonary embolism, CVST — Cerebral venous sinus thrombosis, SVT — Splanchnic vein thrombosis. Vac- 
cines: AZD = Oxford/Astra Zeneca/Serum Institute of India (ChAdOx1), BNT = Pfizer/BioNTech (BNT162b2), MOD = Moderna (mRNA-1273). 


1273, and third dose of ChAdOx1, in the 0-42 days risk period. The 
elevated rates of pericarditis following ChAdOx1 vaccination identified 
in this study rely on a limited number of observed counts in the meta- 
analysis. The wide confidence interval underscores the substantial un- 
certainty of characterizing pericarditis as a safety signal following 
ChAdOx1 vaccination. However, our study confirms findings of previ- 
ously identified rare cases of myocarditis and pericarditis following first 
and second doses of mRNA vaccines [21—23,34]. A large cohort study of 
23.1 million residents across four Nordic countries revealed an increased 
risk of myocarditis among young males aged 16-24 years, based on 4-7 
excess events in 28 days per 100,000 vaccinees after a second dose of 
BNT162b2, and between 9 and 28 per 100,000 vaccinees after a second 
dose of mRNA-1273 [22]. Similarly, studies from British Columbia, 
Canada reported cases of myocarditis to be higher among those 
receiving a second dose compared with a third dose, and for those who 
received a second dose of the mRNA-1273 vaccine compared with the 
BNT162b2 vaccine [35,36]. Patone et al. [37] estimated extra myocar- 
ditis events to be between one and 10 per million persons in the month 
following vaccination, which was substantially lower than the 40 extra 
events per million persons observed following SARS-CoV-2 infection 
period. A systematic review by Alami et al. [38] concluded that mRNA 
vaccinated individuals were twice as likely to develop myocarditis/ 
pericarditis compared with unvaccinated individuals, with a rate ratio of 
2.05 (95 96 CI 1.49-2.82). Given the evidence, WHO issued updated 
guidance regarding these safety signals and mRNA COVID-19 vaccina- 
tion, and EMA provided updates to the Product Information for 
BNT162b2 and mRNA-1273 vaccines [21,23]. TGA as well as the CDC 
continue to monitor and review data on myocarditis and pericarditis 
following COVID-19 vaccination [39,40]. 

Another potential safety signal was identified for ADEM after the first 
dose of mRNA-1273 vaccine, with five more observed than expected 
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events based on 1,035,871 person-years and 10.5 million doses 
administered; however, the number of cases of this rare event were small 
and the confidence interval wide, so results should be interpreted with 
caution and confirmed in future studies. Although some case reports 
have suggested a possible association between COVID-19 vaccination 
and ADEM, there was no consistent pattern in terms of vaccine or timing 
following vaccination, and larger epidemiological studies have not 
confirmed any potential association [41-44]. Moreover, case reports 
may report on coincidental events and do not establish association nor 
indicate causality, thus larger observational studies are warranted to 
further investigate our finding. To address this, a follow-up study is 
currently being undertaken within the GVDN, focusing on a de- 
mographic not included in our analysis. Based on reports of rare ADEM 
cases to the European Database of Suspected Adverse Drug Reaction, 
EMA assessed the potential association of ADEM following vaccination 
with ChAdOx1 [45]. Frontera et al. [46] concluded that chances of 
having a neurological event following acute SARS-CoV-2 infection were 
up to 617-fold higher than following COVID vaccination, suggesting that 
the benefits of vaccination substantially outweigh the risks. A safety 
signal for generalized seizures was identified following Gamaleya 
Research Institute/Sputnik vaccination, however the number of vacci- 
nations was relatively low compared with other vaccines in this study. 
Further studies are warranted to explore this potential safety signal. 

Conducting a cohort analysis in the unique multi-country context of 
the GVDN leverages a vast and diverse data pool. Aggregating data from 
multiple countries on more than 99 million vaccine recipients has 
significantly increased the sample size and the statistical power 
compared with many previous safety studies. This enhances the ability 
to detect safety signals, especially for extremely rare adverse events, as 
the larger sample size provides greater precision in estimating observed 
rates. 
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Fig. 3. Number of events and OE ratios (with 95 % confidence interval) for homologous schedules by dose 1-4, cardiovascular conditions. AESI: MYO = Myocarditis, 
PER = Pericarditis. Vaccines: Vaccines: AZD = Oxford/Astra Zeneca/Serum Institute of India (ChAdOx1), BNT = Pfizer/BioNTech (BNT162b2), MOD = Moderna 


(mRNA-1273). 


Results based on data across Europe, North and South America and 
Oceania offer stronger external validity, enabling findings to be more 
generalizable to a broader range of populations and healthcare settings 
participating in the global COVID-19 vaccination programme. More- 
over, multi-country analyses facilitate comparisons between countries 
with varying vaccination strategies, population demographics, and 
healthcare systems, yielding insights into how these factors may influ- 
ence vaccine safety profiles. Data used in our analysis were drawn from 
multiple databases, including healthcare databases, national immuni- 
zation registries, and vaccination dashboards, allowing the identifica- 
tion of potential safety signals from various sources. 

The results from our study should, however, be interpreted consid- 
ering multiple limitations. Our analyses inherently involve heteroge- 
neity in data collection, quality, and reporting standards across 
countries. These differences in healthcare infrastructure and surveil- 
lance systems can introduce bias and affect the comparability of results. 
The participating sites across the eight countries implemented varied 
vaccination strategies, including vaccine types, dosing schedules, and 
prioritization of vaccine recipients. Moreover, the multi-country ana- 
lyses are susceptible to population confounding factors, such as differ- 
ences in pre-existing health conditions, genetic factors, ethnic profiles, 
and behavioural patterns, which was not possible to adjust for in our 
analysis. We consider our approach suitable for application in large 
datasets representing average populations. However, age- and sex- 
specific historic background rates that are not adjusted for factors like 
prior disease may not provide a suitable comparison, for example, in the 
early stages of a vaccination campaigns where people with co- 
morbidities were vaccinated prior to other population groups. 

Potential underreporting across countries may have led to an un- 
derestimation of the significance of potential safety signals. It is 
important to recognize the potential for false negatives, especially when 
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detecting associations with lower confidence intervals below 1.5 that 
maintain statistical significance. The safety signals identified in this 
study should be evaluated in the context of their rarity, severity, and 
clinical relevance. Moreover, overall risk-benefit evaluations of vacci- 
nation should take the risk associated with infection into account, as 
multiple studies demonstrated higher risk of developing the events 
under study, such as GBS, myocarditis, or ADEM, following SARS-CoV-2 
infection than vaccination. Finally, the use of ICD-10 codes is subject to 
considerations about specificity and sensitivity, and application may 
vary by country. 


5. Conclusion 


Observed vs. expected analyses in a multi-country context of the 
GVDN and the GCoVS Project offers a larger and more diverse dataset, 
enhanced generalizability, and improved statistical power over single 
site or regional studies. It also presents challenges related to data het- 
erogeneity, population confounding factors, and variations in vaccina- 
tion strategies and reporting systems. The involvement of researchers 
and data sources from diverse regions of the world promotes inclusivity, 
reduces potential biases, and fosters collaboration in the pursuit of a 
shared public health goal. While our study confirmed previously iden- 
tified rare safety signals following COVID-19 vaccination and contrib- 
uted evidence on several other important outcomes, further 
investigation is warranted to confirm associations and assess clinical 
significance. This could be addressed by conducting association studies 
specific to individual outcomes by applying methodologies such as the 
self-controlled case series (SCCS) to validate the associations [6]. 
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